Amendments to the Claims: 

This listing of claims will replace all prior versions, and listings, of claims in the 
application. 

1 . (Currently Amended) A method, comprising: 

identifying twe- one or more types of attributes including a type of human 
language spoken e ffrom an information stream that includes audio information ; 

comparing results from two or more different human language models at 
approximately the same time to determine the type of human language spoken ; 

encoding each identified attribute from the information stream that includes audio 
information ; 

assigning a time ordered indication with each of the identified attributes, each of 
the identified attributes sharing a common time reference; and 
generating a time ordered index of the identified attributes. 

2. (Original) The method of claim 1, wherein the information stream includes audio- 
visual data. 

3. (Original) The method of claim 1 , wherein the information stream includes speech 
data. 

4. (Currently Amended) The method of claim 1 , wherein anothe r at l e ast on e of tho 
identified attributes comprises a scene change. 
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5. (Currently Amended) The method of claim 1 , wherein at lo ast on o of the another 
identified attributes comprises a fade. 

6. (Currently Amended) The method of claim 1 , wherein at l o aot ono of the ajiother 
identified attributes comprises a pan. 

7. (Canceled) 

8. (Currently Amended) The method of claim 1 , wherein at loast ono of th e another 
identified attributes comprises a human accent. 

9. (Currently Amended) The method of claim 42, wherein at l oast on o of th e another 
identified attributes comprises image characteristics from the audio-visual data . 

10. (Currently Amended) The method of claim 1 , wherein at lo ast on o of th eajiother 
identified attributes comprises a spoken word. 

1 1 . (Original) The method of claim 1 , wherein the identified attributes are 
encoded via extensible markup language. 

12. (Original) The method of claim 1 , wherein the time ordered indication 
comprises a start time and a time frame in which the identified attribute was conveyed. 
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1 3. (Original) The method of claim 1 , wherein the common time reference 
comprises a frame count. 

14. (Original) The method of claim 1 , wherein the common time reference 
comprises a time indication. 

15. (Original) The method of claim 1, further comprising generating a query on 
the one or more of identified attributes in the time ordered indexed. 

16. (Original) The method of claim 1 , further comprising correlating a first 
identified attribute of the information stream with a second identified attribute having a 
similar time code. 

17. (Original) The method of claim 16, wherein the similar time code comprises 
the first identified attribute possessing a start time approximately the same as the 
second identified attribute or an overlapping of time frames associated with the first 
identified and the second identified attribute. 

18. (Original) The method of claim 1 , further comprising: 

individually synchronizing each word in a transcript from the information stream 
to be frame accurate to corresponding video data based upon both sharing the 
common time reference. 
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19. (Currently Amended) A machine-readable medium that stores instructions, which 
when executed by a machine, tocause the machine to perform operations A comprising: 

identifying two- one or more types of attributes including a type of human 
language spoken offrom an information stream that includes audio information ; 

comparing results from two or more different human language models to 
determine the type of human language spoken ; 

encoding each of the identified attributes from the information stream that 
includes audio information ; 

assigning a time ordered indication with each of the identified attributes, each of 
the identified attributes share a common time reference; and 

generating a time ordered index of the identified attributes. 

20. (Currently Amended) The article of manufacture of claim 19, which contains 
executable instructions to causes the machine to perform further operations comprising: 

generating a query on the one or more of the time ordered indexed identified 
attributes. 

21. (Currently Amended) The article of manufacture of claim 19, which contains 
executable instructions to causes the machine to perform further operations comprising: 

correlating a first identified attribute of the information stream with a second 
identified attribute having a similar time code. 
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22. (Currently Amended) The article of manufacture method of claim 19, which 
contains executable instructions to cause the machine to perform further operations 
furth e r comprising: 

individually synchronizing each word in a transcript from the information stream 
to be frame accurate to corresponding video data based upon both sharing the 
common time reference. 

23. (Currently Amended) An apparatus, comprising: 

means for identifying two or mor e typ e s of attributes including one or more types 
of accents and one or more types of human languages of an information stream that 
includes audio information : 

means for comparing results from two or more different human language models 
at approximately the same time to determine the type of human language spoken and 
the types of accents identified: 

means for encoding each identified attribute from the information stream; 

means for assigning a time ordered indication with each of the identified 
attributes, each of the identified attributes share a common time reference; and 

means for generating a time ordered index of the identified attributes. 

24. (Original) The apparatus of claim 23, further comprising: 

means for generating a query on the one or more of the time ordered indexed 
identified attributes. 

25-39. (Cancelled) 



Application No.: 10/060,495 



6 



Docket No.: 5827P001 



40. (Currently Amended) A machine-readable medium that stores instructions, which 
when executed by a machine, cause the machine to perform operations comprising: 

identifying one or more attributes of an information stream including each spoken 
word from a live broadcast; 

using two or more different human language models to identify each spoken 
word from the live broadcast; 

encoding each of the identified attributes from the information stream; 

assigning a time ordered indication with each of the identified attributes, each of 
the identified attributes share a common time reference; and 

generating a synchronized link to relevant material based on the content of the 
live broadcast, the synchronized link to be displayed with the live broadcast. 

41 . (Original) The article of manufacture of claim 40, which causes the machine 
to perform further operations comprising: 

synchronizing the synchronized link to appear at approximately an utterance of 
the most relevant word related to the content of the live broadcast. 

42. (Currently Amended) An apparatus, comprising: 

means for identifying one or more attributes of an information stream including 
each spoken word from a live broadcast; 

means for using two or more different human language models to identify each 
spoken word from the live broadcast; 

means for encoding each of the identified attributes from the information stream; 



Application No.: 10/060,495 



7 



Docket No.: 5827P001 



means for assigning a time ordered indication with each identified attribute, each 
identified attribute shares a common time reference measurement; and 

means for generating a synchronized link to relevant material based on the 
content of the live broadcast, the synchronized link to be displayed with the live 
broadcast. 

43. (Currently Amended) The apparatus of claim 42, further comprising: 

means for synchronizing the link to appear at approximately an utterance of the 
most relevant word related to the content of the live broadcast. 

converting the identified spoken words in afrthe information stream to written 
text, the information stream containing audio-visual information; and 

generating a separate encoded file for every word, each encoded file contains a 
time ordered indication reference to a relevant video frame from the audio-visual 
information . 

44. (New) The article of manufacture of claim 19, which contains executable 
instructions to cause the machine to perform further operations comprising: 

comparing confidence ratings of the two or more different human language 
models to identify the type of human language being spoken. 

45. (New) The article of manufacture of claim 19, which contains executable 
instructions to cause the machine to perform further operations comprising: 

identifying each spoken word as an additional attribute identified from the 
information stream; 
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detecting shot change information as an additional attribute identified from the 
information stream from the information stream; 

creating thumbnail images for each shot change; and 

generating an encoded file for every shot change, each encoded file containing a 
time ordered indication referencing to one or more corresponding spoken words in that 
shot change. 

46. (New) The article of manufacture of claim 45, which contains executable 
instructions to cause the machine to perform further operations comprising: 

displaying thumbnail images of one or more scene shots corresponding to the 
shot changes based upon a query containing one or more of the spoken words. 

47. (New) The article of manufacture of claim 22, which contains executable 
instructions to cause the machine to perform further operations comprising: 

splicing two or more words from the transcript in order to manipulate the 
corresponding video data. 

48. (New) The article of manufacture of claim 19, which contains executable 
instructions to cause the machine to perform further operations comprising: 

identifying each spoken word as an additional attribute identified from the 
information stream; 

synchronizing video frame information to each identified spoken word based on 
the video information and the identified spoken words sharing the common time 
reference. 
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49. (New) The article of manufacture of claim 48, wherein the common time reference 
is a universal frame count referenced for all of the attributes from the information 
stream and the time ordered indication comprises a beginning frame count referenced 
to the universal frame count and an amount of frames in which the attribute was 
conveyed. 

50. (New) The article of manufacture of claim 48, wherein the time ordered indication 
comprises a start time and a time frame in which the identified attribute was conveyed. 

51 . (New) The article of manufacture of claim 19, which contains executable 
instructions to cause the machine to perform further operations comprising: 

manipulating a first set of identified attributes in order to manipulate a second set 
of identified attributes. 

52. (New) The article of manufacture of claim 51 , wherein the first set of attributes 
compromises a section of transcripted text and the second set of attributes comprises 
video images having approximately the same time ordered indications as the 
transcripted text. 

53. (New) The article of manufacture of claim 19, which contains executable 
instructions to cause the machine to perform further operations comprising: 

identifying one or more spoken words as an additional attribute identified from 
the information stream; 
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triggering a link and synchronizing the appearance of the link with a presentation 
of the one or more identified spoken words from the information stream. 

54. (New) The article of manufacture of claim 53, which contains executable 
instructions to cause the machine to perform operations wherein the link to relevant 
material based is generated upon the one or more words being spoken and 
synchronizing a presentation of the link in less than five seconds from analyzing the 
information stream. 

55. (New) The article of manufacture of claim 19, which contains executable 
instructions to cause the machine to perform further operations comprising: 

identifying one or more spoken word as an additional attribute identified from the 
information stream; 

generating a written transcript of the spoken words that can be directly correlated 
to the common time reference. 

56. (New) The article of manufacture of claim 40, which contains executable 
instructions to cause the machine to perform operations wherein the link to relevant 
material based is generated upon the one or more words being spoken and 
synchronizing a display of the link in less than five seconds from analyzing the 
information stream. 
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